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following  either  of  two  policies. 

r  Various  possible  decision  policies  are  enumerated  for 
both  decision  and  information  feedback  subject  to  the  restric¬ 
tion  that  communication  be  by  binary  sequences  and  that  a 
binary  decision  be  made  for  individual  digits,  as  well  as 
several  other  restrictions.  It  is  then  shown  that,  within  the 


allowed  class  of  systems,  only  the  one  decision  feedback  policy 
described  previously  and  the  two  information  feedback  systems 
described  herein  can  have  the  desired  high-reliability  fail¬ 
safe  properties.  The  first  information  feedback  system,  which 
uses  decision  policies  on  the  forward  and  feedback  channels 
such  that  erasure-to-confirmation  errors  are  always  very  rare 
on  both  channels,  is  shown  to  be  nearly  equivalent,  but  slightly 
inferior,  to  the  decision  feedback  system.  An  exception  to  this 
statement  holds  when  the  feedback  channel  is  extremely  reliable 
in  itself.  The  second  information  feedback  system,  which  uses 
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decision  policies  such  that  confirmation-to-erasure  errors  are 
always  very  rare  on  both  channels,  has  the  advantage  that  re¬ 
liability  depends  on  the  number  of  information  digits  per  code 
word,  rather  than  the  number  of  check  digits  as  in  the  other 
systems.  Thws-,  a  saving  in  the  number  of  forward  channel  check 
digits  is  available.  TJft  fehw  elliui1  TUIM,  the  system  has  the 
disadvantage  that  the  receiver  must  store  tentatively  a  large 
number  of  words. 
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I.  INTRODUCTION 

For  a  feedback  communication  system  to  be  fail-safe, 
complete  failure  ("blackout")  of  either  the  forward  or  feedback 
channel  or  both  must  have  a  very  low  probability  of  causing  a 
final  error  or  omission  in  the  received  message.  Also,  any 
other  channel  condition  should  have  at  least  an  equally  low 

probability  of  causing  an  error. 

12  5 

It  has  been  shown  1  *  that  a  long-code  decision  feed¬ 
back  system  can  be  made  fail-safe,  with  as  low  an  error  proba¬ 
bility  as  desired  at  any  channel  signal- to-noise  ratio,  includ¬ 
ing  the  case  of  complete  blackout.  However,  sincfe  there  are 
situations  which  would  appear  to  favor  information  feedback 
over  decision  feedback,  it  is  useful  to  determine  whether  an 
information  feedback  system  can  also  be  made  fail-safe.  If 
fail-safe  operation  can  be  accomplished,  one  would  then  like 
to  know  the  behavior  and  requirements  of  such  a  system.  The 
purpose  of  this  report  is  to  supply  this  desired  information. 

In  an  information  feedback  system,  as  defined  pre- 
b  *s 

viously,  the  receiver  reports  back  in  whole  or  in  part  the 
received  information,  and  the  sender  then  transmits  corrective 


information  when  necessary.  The  corrective  signal  will  here 
be  restricted  to  the  confirmation  or  erasure-plus-repetition 
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of  some  previously  transmitted  message  words. 

Information  feedback  has  an  advantage  over  decision 
feedback  when  a  highly-reliable  feedback  channel  of  large  ca¬ 
pacity  is  available.  In  fact,  error-free  communication  without 
error-protection  encoding  is  possible  in  an  information  feed¬ 
back  system  if  an  error-free  feedback  channel  is  available  of 

4,5 

capacity  greater  than  the  forward  channel.  However,  when 
extremely  low  error  probabilities  are  desired,  the  assumption 
of  an  error-free  feedback  channel  should  be  avoided.  Although 
information  feedback  procedures  previously  des cr ibed^ ^ •>  6 , 7 
have  shown  how  to  greatly  improve  reliability  under  most  cir¬ 
cumstances,  they  do  not  provide  much  protection  during  a 
"blackout"  of  the  feedback  channel.  The  procedures  described 
in  this  report  are  designed  to  provide  this  protection. 

Although  this  report  is  concerned  primarily  with 
information  feedback,  some  aspects  of  decision  feedback  will 
also  be  discussed  in  order  to  put  the  results  in  better  per¬ 


spective  . 
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II.  ENUMERATION  OF  DECISION  POLICIES 

The  specification  of  "decision"  or  "information" 
feedback  does  not  uniquely  define  the  feedback  procedure. 

There  are  in  fact  a  great  variety  of  possible  procedures. 

This  report  is  restricted  to  a  discussion  of  a  limited  class 
of  systems  and  decision  policies.  First;  communication  by 
binary  digits  is  assumed.  Secondly;  in  order  to  keep  the 
logical  structure  of  the  systems  from  becoming  too  complex,  the 
following  procedures  will  not  be  permitted! 

1.  Cumulative  Feedback 

4 

In  cumulative  feedback;  received  information  is  not 
completely  rejected  or  erased;  but  is  used  in  conjunction  with 
additional  repetitive  information  to  arrive  at  a  final  decision. 
It  is  assumed  here  instead  that  message  words  which  do  not 
meet  a  certain  criterion  are  rejected;  or  erased;  and  repeated. 

2.  Iterated  Feedback 

6  T 

In  iterated  feedback  ’  there  is  more  than  one  level 
of  feedback?  i.e.;  individual  message  words  may  be  tentatively 
accepted  or  repeated  as  a  result  of  one  check,  but  a  group  of 
these  words  may  later  be  rejected,  or  erased,  and  repeated  as 
a  result  of  a  check  over  this  group.  The  various  levels  of 
checking  might  be  all  decision  feedback,  all  information  feed¬ 
back,  or  some  combination.  In  the  system  considered  here, 
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however,  all  acceptances  and  confirmations  are  final. 

3-  Multi -digit  Labeling 

Some  decision  policies  can  be  made  fail-safe  only  if 
a  large  number  of  labeling  digits  are  used.  Thus,  if  long 
coded  message  words  are  used,  it  is  possible  to  assign  a 
separate  label  to  each  word  in  a  long  message,  reserving  some 
information  digits  for  labeling.  These  labels  could  be  used 
to  improve  reliability  in  some  systems.  Since,  for  example, 
only  30  binary  digits  are  sufficient  to  separately  label  a 
billion  message  words,  this  is  not  entirely  impractical,  al¬ 
though  the  increased  complexity  and  decreased  channel  capacity 
are  serious  disadvantages .  The  label  digits  might  have  addi¬ 
tional  value  in  the  processing  of  the  information,  such  as  for 
addressing,  sorting,  etc.  However,  the  systems  considered 
here  will  be  limited  to  the  use  of  a  small  number  of  label 
digits . 

With  the  above  restrictions,  the  receiver  in  a  deci¬ 
sion  feedback  system  divides  received  signal  space  into  two 
regions 1  A  and  R.  If  the  signal  corresponding  to  a  message 
word  is  in  A,  an  indication  of  acceptance  is  sent  over  the 
feedback  channel j  if  it  is  in  R,  a  rejection  (request  for 
repeat)  is  sent  back.  Signal  space  for  the  received  feedback 
signal  is  also  divided  into  two  regions  A  and  R,  corresponding 
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to  acceptance  and  rejection.  In  information  feedback,  the 
receiver  sends  back  a  signal  which  is  some  function  of  the  re¬ 
ceived  message  word.  Depending  on  whether  or  not  this  checks 
at  the  original  transmitter  with  that  which  had  been  sent,  the 
transmitter  sends  either  a  confirmation  or  an  erasure  instruc¬ 
tion.  This  can  be  done  in  one  of  two  ways?  the  transmission 
of  a  new  message  may  imply  confirmation,  in  which  case  only 
the  erasure  instruction  requires  a  separate  signal?  or  the 
erasure-confirmation  information  can  be  sent  entirely  separate 
from  the  main  message.  In  either  case,  when  a  confirmation  or 
erasure  instruction  is  expected,  received  signal  space  must  be 
divided  into  two  regions!  C  (confirmation)  and  E  (erasure). 
Also,  the  transmitter  must  decide  whether  an  erasure  or  con¬ 
firmation  has  been  received,  so  that  there  is  also  a  received 
signal  space  divided  into  C  and  E  regions  on  the  feedback 
channel.  For  compound  feedback  (combined  decision  and  informa¬ 
tion  feedback) ,  received  signal  space  on  both  forward  and  feed¬ 
back  channel  may  have  C,  E,  B,  and  A  regions. 

how,  even  when  channels  are  poor  or  completely  blacked 
out,  at  least  one  of  the  received  signal  regions  on  each  chan¬ 
nel  must  have  a  high  probability  of  occurrence.  Exactly  which 
regions  have  high  probability  depends  on  the  decision  policy  of 
the  system.  Table  I  enumerates  the  various  possibilities  for 
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Type  of  Regions  of  High  Probability  Comments 

Feedback  During  Blackout 

Feedback  Channel  Forward  Channel 


Decision  1.  R 

Feedback 

2.  R 

3.  R 

h.  A 

5-  a,r 

6.  .A 

7-  A,R 

8.  A,R 

9.  A 


R 

A 

R,A 

R 

R 

A 

A 

A,R 


A,R 


} 

} 

1 


This  is  the  long-code  fail-safe 
system.  ^>2 


These  will  work  only  if  a  large 
number  of  label  digits  are  used. 

This  requires  a  series  of  repeat 
instructions  and  many'-  label 
digits . 


Wrong  messages  are  received,  and 
some  others  are  lost. 


Information  1.  C 

Feedback 

2.  C,E 

3.  C 

4.  C,E 

5-  E 


E 

C,E 

C,E 

E 

S 


A  C-E-C  (or  message,  M)  chain 
causes  a  final  error  by  permanently 
erasing  a  good  message. 


This  is  a  possible  fail-safe  system. 


6.  C 


C 


This  is  a  possible  fail-safe  system. 


7-  E 

8.  E 

9.  C,E 


An  E-C-E  chain  causes  a  final  error, 
unless  a  large  number  of  label 
digits  are  used. 


Table  I. 

ENUMERATION  OF  DECISION  POLICIES 
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decision  and  information  feedback.  In  the  enumeration,  "high 
probability"  is  taken  to  mean  any  probability  considerably  higher 
than  the  desired  fail-safe  system  error  probability. 

Of  the  nine  decision  feedback  policies,  only  the  first 
permits  a  fail-safe  system  under  the  above-mentioned  restrictions. 
The  long-code  decision  feedback  system  described  in  a  previous 
report1  is  of  this  type.  In  the  second  and  third  policies,  all 
messages  are  nearly  certain  to  be  received  correctly  with  the 
proper  procedure,  but  a  good  number  of  extraneous  "messages" 
would  be  interspersed  among  them  in  the  final  receiver  record. 

The  use  of  a  large  number  of  label  digits  could  allow  the  receiver 
to  "weed  out"  these  extraneous  messages  so  as  to  produce  near¬ 
perfect  reception.  In  the  fourth  and  fifth  policies,  nearly  all 
accepted  messages  would  be  correct,  but  a  series  of  repeat  in¬ 
structions  would  be  needed  in  order  to  make  the  transmitter  go 
back  and  repeat  messages  thought  to  have  been  accepted.  Also, 
many  label  digits  might  be  required  so  that  the  receiver  could 
distinguish  desired  repeats  from  new  messages. 

Of  the  nine  information  feedback  policies,  only  the 
fifth  and  sixth  permit  a  fail-safe  system  under  the  above-men¬ 
tioned  restrictions .  These  systems  are  discussed  in  sections  III 
and  IV,  respectively.  In  the  first  four  procedures,  a  confirma¬ 
tion  can  easily  be  falsely  received  as  an  erasure.  When  this 
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erasure  is  fed  back,  it  can  easily  be  misinterpreted  that  a 
confirmation  has  been  received.  This  C-E-C  error  chain  results 
in  the  permanent  erasure  of  a  good  message,  and  thus  a  final 
error.  In  the  last  three  policies,  an  E-C-E  (E-*C  on  forward 
channel,  C-*E  on  feedback  channel)  error  chain  is  likely.  In 
the  case  in  which  a  new  message  is  used  to  imply  confirmation, 
this  introduces  an  extraneous  message,  and  thus  a  final  error 
unless  a  large  number  of  label  digits  are  used.  If  the  confir¬ 
mation-erasure  information  is  separate,  then  a  word  which  should 
have  been  erased  is  likely  to  be  retained,  and  there  is  a  final 
error.  The  proportion  of  messages  which  should  be  erased  is 
quite  appreciable  in  the  latter  case,  as  the  erasure  is  the 
system's  only  protection  against  blackouts  and  poor  conditions. 
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III.  INFORMATION  FEEDBACK  WITH  ERASURE- TO -CONFIRMATION  ERRORS 
RARE 

The  case  discussed  in  this  section  corresponds  to  the 
fifth  on  the  list  of  information  feedback:  policies.  Since  the 
C-region  is  of  low  probability;  E->C  errors  are  rare. 

Consider  first  that  messages  are  transmitted  by  coded 
binary  sequences,  and  that  one  of  the  sequences  is  reserved  to 
indicate  erasure,  while  the  transmission  of  an  actual  message 
implies  confirmation.  In  order  that  the  C-region  be  of  low 
probability  when  channel  conditions  are  poor,  most  of  received 
message  space  must  be  interpreted  as  an  erasure  instruction  in 
this  situation.  One  way  of  assuring  this  is  to  have  most  binary 
sequences  interpreted  as  erasure  in  the  decision  scheme,  and 
only  a  small  proportion  as  any  message  word.  An  improvement  of 
this  procedure  is  possible  if  the  receiver  is  able  to  monitor 
channel  conditions  in  some  way,  and  vary  the  fraction  of  message 
space  interpreted  as  erasure  according  to  the  estimate  of  chan¬ 
nel  conditions.  When  it  is  judged  that  the  signal- to-noise 
ratio  is  very  poor,  any  received  signal  could  be  interpreted  as 
an  erasure,  while  when  channel  conditions  appear  to  be  good,  an 
appreciable  fraction  of  possible  received  sequences  could  be 
interpreted  as  messages.  Such  a  procedure  could  reduce  somewhat 
the  number  of  check  digits  required  for  a  fail-safe  system  with 
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a  prescribed  reliability.  However,  it  is  assumed  in  what  fol¬ 
lows  that  the  decision  criterion  for  a  received  binary  sequence 
must  be  maintained  constant,  and  must  be  preceded  by  binary 
decisions  on  each  received  digit. 

III. A.  Description  of  the  System  Logic 

The  high-probability-erasure  decision  policy  can  be 
used  to  construct  a  fail-safe  information  feedback  system  by 
following  the  procedure  to  be  shown  here.  In  the  description, 
it  is  assumed  for  simplicity  that  the  transmitter  waits  for  a 
return  signal  before  sending  the  next  transmission.  If  a  fail¬ 
safe  system  can  be  found  for  this  case,  it  can  also  be  found 
for  the  situation  in  which  there  is  no  waiting  for  a  return 
signal.  One  way  this  can  be  done  is  by  dividing  the  information 

to  be  transmitted  into  groups,  and  interlacing,  just  as  was  de- 
12  3 

scribed  previously  ’  ’  for  the  fail-safe  decision  feedback 
system.  Also,  it  should  be  possible  to  do  it  without  inter¬ 
lacing,  by  the  use  of  several  additional  labeling  digits,  as 
was  also  described  previously. 

Since  undesired  erasures  may  occur  quite  frequently  at 

times,  it  would  not  be  wise,  in  this  case,  to  use  a  procedure 

4 

recommended  previously,  in  which  j  consecutive  erasures  were 
interpreted  as  an  instruction  to  erase  the  j  messages  received 
prior  to  the  first  erasure.  Rather,  it  is  found  more  efficient 
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to  allow  an  erasure  to  erase  an  erasure ,  so  that  an  odd  number 
of  consecutive  erasures  is  interpreted  by  the  receiver  to  be 
an  instruction  to  erase  one  message  word,  while  an  even  number 
of  consecutive  erasures  is  ignored. 

The  trickiest  situation  to  handle  is  that  in  which  the 
transmitter  has  sent  a  message  word,  but  then  receives  an  era¬ 
sure  via  the  feedback  channel.  There  are  three  possibilities 
in  this  case! 

a.  The  receiver  has  been  instructed  to  erase  a  word  which 
should  not  have  been  erased,  and  also  has  not  received  the  most 
recent  intended  message  word.  By  transmitting  another  erasure, 
it  is  possible  to  "erase  the  erasure."  It  is  also  necessary  to 
retransmit  the  most  recent  intended  word.  An  alternative  ap¬ 
proach  is  to  require  the  transmitter  to  repeat  the  two  words 
last  transmitted,  rather  than  to  erase  the  erasure.  This  latter 
approach  was  studied  first,  but  was  discarded  in  favor  of  the 
former,  which  is  more  direct  and  effective.  It  is  described  in 
Appendix  I  for  reference. 

b.  The  receiver  has  received  the  message  word  correctly, 
but  there  has  been  a  feedback  channel  C->E  error.  In  this 

case  the  subsequent  erasure  will  erase  a  good  message  word,  but, 
since  this  word  will  be  repeated,  it  is  not  lost. 

c.  The  receiver  has  received  an  incorrect  word,  and  there 
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has  been  a  feedback  channel  C-*E  error.  In  this  case  the  sub¬ 
sequent  erasure  will  erase  an  erroneous  word,  so  that  the  system 
again  operates  safely. 

The  logic  of  the  system  is  probably  best  understood  by 
reference  to  a  state  diagram.  Figure  1  shows  the  state  diagram 
for  the  transmitter.  The  labels  for  the  transitions  refer  to 
what  has  been  received  on  the  feedback  channels  an  E  indicates 
an  erasure j  the  symbol  MV means  that  a  message  word  (and  con¬ 
firmation)  appears  to  have  been  received  and  the  return  signal 
checks j  and  MX  means  that  a  message  word  appears  to  have  been 
received  but  the  return  signal  does  not  check. 

III.B.  Error  Probability  Analysis 

If  the  only  errors  which  occur  are  C->E  errors,  the 
final  received,  record  is  error-free  and  complete.  Figure  2 
shows  a  sample  chain  of  transmissions  when  only  C-»E  errors 
occur.  Erroneous  transmissions  are  indicated  by  dashed  lines, 
and  an  X  below  a  message  indicates  that  it  has  been  erased  by 
the  receiver.  The  symbol  indicates  that  the  returned  signal 
is  interpreted  as  reception  of  a  word  in  the  group  containing 
message  word  A.  (In  total  information  feedback,  A  is  the  only 
word  in  the  group,  but  in  partial  information  feedback  there  is 
more  than  one  word  in  each  group.) 

The  effects  of  rarer  types  of  errors  are  shown  in 
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Pig.  3 •  In  each  case,,  only  one  rare  error  (plus  one  or  more 
of  the  commoner  C-»E  errors  is  considered.  It  can  he  seen  from 
cases  a.  and  b.  that  an  A-+Y  type  error  on  the  forward  channel 
is  always  corrected  if  not  followed  shortly  thereafter  by  another 
rare  error.  On  the  other  hand.,  from  c)taxi  E-*Y  error  on  the 
forward  channel  causes  a  final  error  if  followed  by  a  Y-*E  error 
on  the  feedback  channel.  If  a  Y-*E  error  does  not  follow  (case 
d),  the  result  is  that  A  is  recorded  twice  by  the  receiver.  By 
using  one  label  digit  which  alternates  from  word  to  word,  the 
receiver  would  be  able  to  detect  this  as  an  undesired  repeat, 
and  thus  cross  out  one  of  the  A's.  Whether  this  is  worth  doing 
depends  on  whether  this  case  would  contribute  much  to  the  overall 
error  probability  if  it  were  not  done. 

Cases  (e)-»-(h)  deal  with  feedback  channel  errors.  An 
E-*Gy  feedback  error  does  not  cause  a  final  error  if  preceded  by 
an  A->E  forward  error  (case  e),  but  it  does  lead  to  a  final 
error  if  E  actually  was  the  previous  forward  transmission  (case 
f).  An  E-*Ga  feedback  error  (case  g)  causes  a  final  error, 
where  A  was  the  previous  forward  transmission,  but  this  case  is 
much  rarer  than  (f),  since  it  requires  a  return  to  the  exact 
group  containing  A.  Finally,  an  A-+Gy  feedback  error  (case  h) 
does  not  lead  to  a  final  error. 


I 


16 


(a) 


A  Gy-  E  E-A 

\  !  \  t  <°K> 


y  e 


A—Y  Forward  Error 


(b) 

A  E-E  E-A 

\f  \/  ^ 

Y  E 

A~—Y  Forward  Error 


(c) 


E 


E-E  E-A 

/  \  t. 

4  \  *(  Final 

1  \  I  Error) 

Y 

Forward  Error 


(e) 


Gy-  E  E-A 

/  \  /  <0K> 
E 

Feedback  Error 


A  Ga 
\  /  ( Final 

\  '  E rror) 

E 

E-*—Ga  Feedback  Error 


(d) 


\; 


E-E  Y-  E  E-A 
'  \  I  \  /  \  (OK  if  a 

\  f  \  f  \  Labe! Digit 


aye 

E~-  Y  Forward  Error 


is 


ef  U/g/t 
Used) 


(f) 

E  Gy-  E  E-A 

\  f  \  !  ( Final  E rror) 

E  E 

E^-G  Feedback  E rror 

(h) 

A  Gy-  E  E-A 

\/  \/  (0K> 

A  E 

A-'—  Gy  Feedback  Error 


Fig.  3 

Effects  Of  Rarer  Types  Of  Errors 


I 


17 


For  the  case  of  partial  information  feedback  only, 
there  is  also  a  possible  final  error  caused  by  the  chain! 


W  (in  the  same  group  as  A) 

However,  since  a  vord-to-any  other  word  error  is'  rare  in  this 
procedure,  such  an  error  is  completely  negligible  so  long  as 
there  are  a  reasonably  large  number  of  different  feedback  groups. 

A  transmission  must  contain  at  least  one  "rare”  error 
in  order  to  cause  a  final  error.  Therefore,  define  error  proba¬ 
bility,  P  ,  as  the  probability  that  a  particular  transmission 
loop  (one  forward  transmission  plus  one  feedback  transmission) 
contains  a  rare  error  which  leads  to  a  final  error.  This  defi¬ 
nition  is  chosen  to  avoid  the  presently  unneeded  consideration 
of  the  weighting  of  the  various  types  of  final  errors  and  their 
effects,  which  is  a  rather  subjective  weighting  unless  a  very 
specific  system  is  postulated. 

The  error  probability  due  to  case  (c)  error  chains 

alone  is 

Pc  =  P(S2)  P  [(E-^JJpro,  (Y-»E)pB/S2]  , 


(1) 


18 


where  P(S2)  is  the  probability  that  the  transmitter  is  in  state 
2,  and  (V}  represents  the  set  of  all  message  words  (except  the 
erasure  word) .  When  either  channel  is  blacked  out,  the  trans¬ 
mitter  is  in  state  2  about  one-half  the  time,  so  that,  in  this 
case, 

P(S2)  =  1/2  .  (2) 

Also,  when  the  feedback  channel  is  blacked  out,  the  probability 
of  a  Y-»E  error  is  close  to  unity.  Thus,  in  this  case, 

pc  =  |  pj/E-KY&proJ  .  (3) 

Eor  case  (f) , 

Pf  =  P(S2)  PpE-GyJpg/Ss]  .  (k) 

During  a  blackout  of  either  or  both  channels, 

Pf  =i  pJ/E-^pb]  .  (5) 

Case  (g)  is  much  rarer  than  (f),  as  mentioned  before, 
and  case  (d)  does  not  cause  a  final  error  if  we  use  a  label 
digit.  Thus,  to  a  good  approximation, 

Pe  =  Pc  +  Pf  .  (6) 


The  above  discussion  is  fairly  general,  and  does  not 
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specify  the  exact  form  of  the  message  words.  Consider  now  the 
situation  of  principal  interest,  that  in  which  transmission  is 

6  7 

by  coded  binary  sequences.  It  was  shown ’  '  that  a  coded  inf or- 

Q 

mation  feedback  system  employing  parity  check  (group  alphabet  ) 
codes  contains  an  (n,k)  code  composed  of  an  (n',k)  code  in  the 
forward  direction  and  an  (n",k")  code  in  the  feedback  direction, 
where  k”  <  k  and  n'  +  n"  =  n.  (In  total  information  feedback, 
k"  =  k.)  Figure  4  shows  a  pictorial  representation  of  decision 
space  for  the  forward  and  feedback  channels.  The  exact  error 
probability  for  such  codes  cannot  be  determined  without  speci¬ 
fying  an  exact  code  and  the  channel  noise  statistics.  However, 
the  error  probabilities  can  be  calculated  for  the  case  in  which 
the  noise  is  so  great  that  all  sequences  are  equally  likely  to 
be  received,  regardless  of  what  was  transmitted.  (This  is 
usually  the  worst  case.)  If  just  the  forward  channel  is  blacked 
out  in  such  a  manner,  then 

Pe  i  |  S'  2_(n'"k)  p[(Y-*E)pB]  .  (7) 

If  the  feedback  channel  alone  is  blacked  out, 

Pe  =  \  S"  2"(n""k")  .  (8) 

If  both  channels  are  blacked  out, 
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Pe  ;  1  S'  +  1  S"  (9) 

2  2 

If  the  system  is  designed  so  that  operation  is  nomally 
at  a  rather  good  signal- to-noise  ratio,  then  S'  (or  S”)  may  he 
made  small  without  getting  many  erasures  except  when  channel  con¬ 
ditions  are  poor.  Typically,  S'  (or  S")  =1  for  error  detection, 
or  S'  =  n*  +1  (S"  =  n"  +  l)  for  single-error  correction.  Thus, 
reliability  may  be  made  as  high  as  desired  by  choosing  a  sufficient 
number  of  check  digits  over  each  channel  (n'-k  over  the  forward 
channel  and  n"-k"  over  the  feedback  channel). 

III.C.  Evaluation  and  Comparisons 

If  one  compares  the  system  described  abpve  with  the 
long-code  fail-safe  decision  feedback  system, 3  same  interest¬ 
ing  observations  can  be  made.  In  a  decision  feedback  system  using 
an  (n',k)  code  on  the  forward  channel,  and  having  S  sequences  as¬ 
sociated  with  each  message  sequence  in  decision  space,  the  error 
probability  during  a  blackout  of  the  forward  channel  is 

Pe  =  S  2-<n’-k>  ,  (10) 

and  it  would  normally  be  about  twice  this  value  if  both  channels 
were  blacked  out.  Thus,  for  the  same  code  structure  and  decision 
criterion  in  the  forward  channel,  the  decision  feedback  system 


is  essentially  as  reliable  as  this  information  feedback  system 
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when  both  channels  are  blacked  out,  and  poorer  only  by  the 
factor  ~  p[( Y-*E)pg]  when  just  the  forward  channel  is  blacked 
out.  Also,  the  number  of  message  words  repeated  is  about  the 
same  for  both  systems.  Since  the  decision  feedback  system  need 
not  waste  a  comparable  amount  of  feedback  channel  capacity,  this 
strongly  favors  the  decision  feedback  system.  On  the  other  hand, 
even  though  the  very  critical  exponential  behavior  is  the  same 
in  both  cases,  P  [(y-*e)pb]  can  be  quite  small  if  the  feedback 
channel  is  extremely  good,  and  this  could  favor  the  information 
feedback  system  if  wastage  of  feedback  channel  capacity  were  a 
minor  factor. 

The  somewhat  unfavorable  performance  of  this  informa¬ 
tion  feedback  system  in  comparison  to  decision  feedback  can 
also  be  explained  with  the  aid  of  the  following  reasoning.  By 
checking  the  received  message  against  what  had  been  transmitted, 
it  is  possible  to  reduce  the  probability  of  an  uncorrected  word- 
to-other  word  error  as  much  as  desired.  This  is  a  valuable 
property  of  information  feedback.  However,  E-*Y  errors  cannot 
be  corrected  with  consistency,  because  compensating  Y— *E  errors 
may  occur  frequently  on  the  feedback  channel  as  a  result  of  the 
fact  that  E->Y  errors  must  be  kept  rare  on  this  channel  as  well 
as  the  forward  channel.  Thus,  since  only  one  of  the  two  impor¬ 
tant  classes  of  errors  (word-to-other  word  and  E->Y)  receives 
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full  protection  from  the  check  at  the  transmitter,  there  is 
little  to  he  gained,  if  fail-safeness  is  the  main  criterion,  by 
having  the  transmitter  check  whether  the  message  agrees  or  not. 
Thus,  the  receiver  would  do  almost  as  well  hy  sending  hack  just 
an  indication  of  whether  a  message  or  an  erasure  was  received. 
Then,  if  an  erasure  instruction  is  ignored,  as  it  should  he  in 
this  case,  the  erase  symbol  plays  the  role  of  a  reject  symbol, 
and  the  system  is  identical  to  decision  feedback. 

The  above  conclusions  are  subject  to  the  assumption  of 
a  received  signal  space  of  binary  sequences  only.  This  is  not 
essential,  however,  even  if  the  message  words  are  binary  se¬ 
quences.  The  erasure  signal  could  be  entirely  non-binary.  For 
example,  it  could  consist  of  complete  suppression  of  the  modula¬ 
tion  or  transmitted  signal,  much  as  has  been  done  in  a  particular 

9 

commercial  decision  feedback  system.  Suppose  that  a  binary  re¬ 
ceived  signal  space  were  used  for  decision  only  if  positive 
recognition  of  binary  digits  in  the  signal  were  first  obtained; 
otherwise,  a  transmitted  erasure  woujd  be  assumed.  Then,  an 
E -*Y  error  could  be  made  virtually  impossible,  even  with  little 
or  no  coding  in  the  forward  channel.  The  same  could  be  done  for 
E-»Gy  errors  on  the  feedback  channel.  The  possibilities  of  such 
a  system  are  well  worth  further  investigation. 
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TII.D.  Separate  Confirmation-Erasure  Signal 

An  alternative  to  the  approach  described  thus  far  in 
this  section  is  to  indicate  confirmation  or  erasure  via  a 
separate  signal.  If  we  are  again  restricted  to  binary  received 
signal  space ,  and  if  3  sequences  are  associated  with  a  confir¬ 
mation  interpretation,  the  black-out  probability  of  an  E-»C 
error  is  no  better  than  S*2"c,  where  c  is  the  number  of  digits 
in  the  binary  sequence  carrying  the  confirmation-erasure  infor¬ 
mation.  However,  it  is  possible  to  do  just  as  well  as  this  by 
using  a  decision  feedback  system  with  these  c  digits  as  check 
digits,  so  that  this  approach  does  not  offer  any  improvement 
over  the  first  approach,  at  least  if  decisions  must  be  based  on 
binary  sequences. 
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IV.  INFORMATION  FEEDBACK  WITH  CONFIRMATION-TO-ERASURE  ERRORS 
RARE 

The  case  discussed  in  this  section  corresponds  to  the 
sixth  on  the  list  of  information  feedback  policies.  Since  the 
E-region  is  of  low  probability,  C-*E  errors  are  rare. 

Assume  again  the  transmission  of  binary  sequences, 
with  a  fixed  decision  criterion  at  the  receiver  preceded  by 
binary  decisions  on  each  digit.  Also  assume  that  transmission 
of  a  new  message  word  implies  confirmation.  Then,  since  the 
E-region  must  be  of  low  probability  when  channel  conditions  are 
poor,  most  of  the  possible  received  sequences  must  be  inter¬ 
preted  as  same  message  word. 

IV.A.  Description  of  the  System  Logic 

The  high-probability-confirmation  decision  policy  can 
be  used  to  construct  a  fail-safe  information  feedback  system  by 
following  the  procedure  to  be  shown  here.  Again,  it  is  assumed 
for  simplicity  that  the  transmitter  waits  for  a  return  signal 
before  sending  the  next  transmission.  This  is  not  a- basic  limi¬ 
tation,  however,  for  the  reasons  mentioned  in  section  III. A. 

A  basic  consequence  of  the  postulated  decision  policy 
is  that,  during  a  blackout,  many  erroneous  message  words  will 
be  recorded  at  the  receiver,  and  thus  there  must  be  a  way  of 
erasing  these  words  in  order  to  have  a  fail-safe  system.  This 
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can  be  done  by  means  of  a  eries  of  erasure  instructions ,  Ex, 

E2,  ....  Er,  where  erasure  instruction  E^  is,  "erase  the  pre¬ 
vious  dj_  words."  It  is  not  necessary  and  may  not  be  desirable 
to  have  all  dj_  =  i.  Typically,  di  might  have  the  value  1,  2, 

3,  5,  10;  20,  50,  200,  1,000,  50,000.  If,  say,  the  previous 
16  words  should  be  erased,  one  would  erase  the  previous  20. 

There  is  more  than  one  possible  arrangement  of  erasure 
signals  in  the  set  of  possible  feedback  signals.  The  receiver 
may  attempt  to  give  some  information  about  which  erasure  in¬ 
struction  has  been  received,  or  may  even  specify  it  exactly. 
However,  it  will  be  seen  from  the  error  probability  analysis  to 
follow  that  the  probability  of  an  erasure-to-other  erasure  in¬ 
struction  error  can  be  made  so  small  as  not  to  need  additional 
protection  from  the  information  feedback  process.  Therefore, 
the  best  procedure  appears  to  be  to  put  all  the  erasures  into 
one  group  in  the  feedback  transmission,  and  thus  just  indicate 
that  some  erasure  instruction  was  received. 

The  logic  of  this  system  is  fairly  simple.  When  the 
transmitter  gets  back  a  message  which  does  not  agree  with  what 
was  sent,  it  sends  erasure  instruction  E*.  If  anything  but  the 
erasure  group  E  is  returned  via  the  feedback  channel,  instruction 
E2  is  sent.  When  the  number  of  erasures  to  be  indicated  does  not 
correspond  to  an  available  instruction.,  the  next  greater  number 


) 
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is  requested  to  be  erased.  When  an  erasure  instruction  finally 
results  in  the  return  of  an  erasure  signal  via  the  feedback 
channel,  the  transmitter  goes  back  to  the  appropriate  word  in 
the  message  chain.  Because  not  all  clj.  =  i,  this  sometimes 
necessitates  erasing  a  number  of  correctly  received  and  con¬ 
firmed  words. 

In  obeying  the  erasure  instruction,  the  number  of  words 
to  be  erased  is  taken  to  include  any  previous  received  erasure 
instructions.  Thus,  the  reception  of 

Mg  M{f  Mij  Ej  Mg  My  Eg 
X  X  X  X  X  X 


would  require  erasure  of  the  six  positions  indicated  by  X, 
though  only  five  actual  message  words  are  erased. 

IV. B.  Error  Probability  Analysis 

Figure  5  shows  a  sample  chain  of  transmissions  when 
only  E-*C  and  message-to-other-message  errors  occur.  The  nota¬ 
tion  is  as  in  Figure  2.  If  only  errors  of  the  type  shown  occur. 


Transm. 


Receiver 


Gz-E3  gE‘\  gA"b. 

-  \/  \/  \ 


E3 


Figure  5 


Effect  of  E-+C  and  word-to-other-word  errors. 
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the  final  received  record  is  error-free  and  complete. 

A  final  error  usually  occurs  if  one  has  an 
error  on  the  forward  channel,  (j^i).  and  a  compensating  Gj~> 
error  on  the  feedback  channel.  Also,  an  erasure-to-other  era¬ 
sure  instruction  error  nearly  always  causes  a  final  error,  and 
we  shall  assume  that  a  C-*E  error  on  the  forward  or  feedback 
channel  causes  a  final  error.  Special  procedures  might  elimi¬ 
nate  something  like  half  of  the  latter  final  errors  under  same 
circumstances,  but  this  is  of  little  significance. 

Assume  that  each  message  word  consists  of  a  sequence 
of  coded  (or  possibly  uncoded)  binary  digits,  of  which  k  are 
information  bits .  The  2^  possible  words  include  r  erasure  in¬ 
structions.  Each  received  sequence  is  interpreted  as  one  of 
the  messages  or  erasures,  and  it  is  assumed  that  each  message 
or  erasure  instruction  has  about  the  same  number  of  interpretable 
sequences  associated  with  it  (just  one  each  in  the  uncoded  case). 
Then,  during  a  blackout,  the  following  transition  probabilities 
exist  on  the  forward  channel! 


(10) 

P(Ms-*E3  ^  f  .  r2-*  i 

(11) 

P(E,  — >Mg  aU  s)  =  1  -  r2'k  =  1  s 

(12) 

P(Mk-*Ms)  =  2-*  . 

(13) 

I 
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On  the  feedback  channel  there  are  2^  possible  trans¬ 
mitted  sequences  (k"  ^  k) ,  one  of  which  represents  the  set  of 
erasure  instructions.  During  a  blackout,  the  following  transi¬ 
tion  probabilities  exist  on  the  feedback  channel! 


P(E  -frfGrjaH  r)  =  1  “  2"k"  =  ^ 

(14) 

P(Gr— *E)  =  2-k"  j 

(15) 

P(Gr— >GS)  =  2_k"  . 

(16) 

When  the  forward  channel  alone  is  blacked  out,  the 
error  probability  is  approximately  the  sum  of  ( 10)  and  ( 11) j 
when  both  channels  are  blacked  out,  it  is  approximately  the  sum 
of  (10),  (11),  (15),  and  (16).  (Equation  (16)  represents  the 
case  in  which  an  Mg— >1^  error  has  occurred  on  the  forward  chan¬ 
nel,  and  a  Gr~ *GS  error  follows  on  the  feedback  channel.) 

By  choosing  k  and  k"  sufficiently  large,  the  blackout 
error  probability  can  be  made  as  small  as  possible.  No  coding 
is  necessary  for  this  purpose. 

In  the  fail-safe  decision  feedback  system,  the  case  of 
complete  blackout  was  shown  to  be  the  case  of  highest  error 
probability.  Because  of  the  similar  structure,  this  is  also 
true  of  the  information  feedback  system  described  in  section 
III.  However,  for  the  information  feedback  system  described  in 
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this  section,  there  is  one  more  thing  which  must  be  done  before 
it  can  be  assured  that  the  system  will  be  equally  free  of  errors 
under  other  than  blackout  conditions. 

Suppose  that  there  were  no  coding,  and  that  the  re¬ 
ceiver  simply  sent  back  each  group  of  k  digits  exactly  as  re¬ 
ceived.  Assume  also  that  conditions  on  both  channels  are  such 
that  the  occurrence  of  exactly  one  error  in  k  is  quite  common. 
Then,  in  l/k  of  the  cases,  in  which  exactly  one  digit  error  per 
block  occurs  on  each  channel,  the  returned  message  agrees  with 
what  had  been  sent,  even  though  the  received  message  contains 
a  single  digit  error.  This  would  not  be  a  satisfactory  situa¬ 
tion  if  extremely  high  reliability  communication  were  desired. 

The  system  can  be  made  virtually  error-free  under  all 
conditions  as  well  as  just  during  blackout  conditions  by  the 
simple  expedient  of  applying  a  linear  transformation  to  the  re¬ 
ceived  sequence  in  order  to  obtain  the  feedback  sequence.  This 

k  5 

solution  is  based  chiefly  on  the  idea  of  Chang  that  sequences 
close  together  in  the  forward  channel  should  be  far  apart  (or 
at  least  not  close)  in  the  feedback  channel. 

Consider  the  case  of  total  information  feedback  without 
coding.  Let  the  k  forward  digits  be  called  ix,  is,  ••••  i^,  and 
let  the  corresponding  feedback  digits  be  fx,  fs,  .... 


fjj.  Then, 
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c  * 

fl 

ii 

fa 

ia 

• 

=  M 

• 

5k. 

.lk. 

(17) 


where  M  is  a  k  x  k  matrix  of  I's  and  o's.  (Multiplication  is 
ordinary.,  hut  addition  is  taken  modulo  two.)  The  matrix  M  may 
he  chosen  at  random,  provided  only  that  it  possesses  an  inverse. 
The  latter  property  ensures  a  one-to-one  correspondence  between 
the  forward  and  feedback  sequences. 

Now,  if  some  digit  ij  should  be  altered  in  the  forward 
transmission,  the  sequence  fi,  ...  fjj  will  differ  in  many  posi¬ 
tions  from  what  it  would  otherwise  be.  (More  precisely,  it  will 
differ  in  as  many  digits  as  there  are  ones  in  column  j  of  [m].) 
Thus,  for  almost  any  choice  of  [mJ,  there  will  be  a  negligible 
chance  of  a  compensating  feedback  error  under  any  channel  condi¬ 
tions.  The  reasoning  to  support  this  statement  is  almost  identi¬ 
cal  to  that  given  in  the  decision  feedback ■  report’1'  when  averages 
over  randomly  chosen  codes  were  considered. 


The  same  procedure  can  be  carried  out  in  the  case  of 


32 


partial  information  feedback,  with  or  without  coding.  More 

details  are  given  in  Appendix  II.  For  partial  information 

feedback,  however,  there  is  one  additional  error  which  must  be 

considered  for  non-blackout  conditions.  This  is  the  possibility 

of  a  forward  channel  error  in  which  the  erroneous  word  is  in  the 

same  feedback  group  as  the  correct  word.  The  probability  of 

such  an  error  can  be  estimated  by  considering  a  randomly- chosen 

8 

(k,  k-k")  parity  check  code.  Figure  6  shows  the  Slepian  array 
for  such  a  code.  Let  each  of  the  2^  sequences  in  the  array 
represent  a  forward  channel  message  word.  If  the  feedback  groups 
are  chosen  as  the  cosets,  the  2^  parity  sequences  of  the  code 


V-V'” 

2^  *•  columns  of  k-digit  sequences 


Figure  6 

The  Slepian  Array 
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become  the  feedback  information  digits.  Also,  it  can  readily 
be  seen  that  the  probability  of  an  error  to  another  message  in 
the  same  group  is  identical  to  the  probability  of  an  undetected 
error  in  a  zero-error  correction-  (k,  k-k")  code.  This  has  al- 
ready  been  shown  to  be  about  2-1L  or  less  for  most  codes  at  any 
channel  signal- to-noise  ratio.  Thus,  the  error  probability  for 
this  case  is  also  negligible  for  sufficiently  large  k" . 

IV. C.  Evaluation  and  Comparisons 

Unlike  the  approach  of  section  III,  the  number  of  check 
digits  (or  redundant  digits)  in  the  forward  direction  need  not 
be  large,  since  reliability  is  dependent  on  the  number  of  infor¬ 
mation  digits  in  the  message  word,  rather  than  the  number  of 
check  digits.  In  fact  it  is  possible  to  have  no  coding  at  all, 
as  was  mentioned,  although  one  might  use  some  simple  error  cor¬ 
rection  to  reduce  the  frequency  of  erasures . 

However,  in  addition  to  advantages,  there  are  also 
disadvantages.  Although  no  coding  is  needed,  the  requirement 
of  a  matrix  operation  on  the  received  word,  while  not  especially 
complex,  is  hardly  much  simpler  than  the  coding  and  decoding 
scheme  used  in  the  fail-safe  decision  feedback  system  or  in  the 
other  information  feedback  system  described  here.  Also,  it  is 
required  that  the  receiver  be  able  to  store  tentatively  a  large 


number  of  message  words,  and  that  the  erase  capability  be  larger 


than  the  longest  blackout  period.  In  some  situations,  this 
latter  disadvantage  may  not  be  too  great,  since  the  d^  may  be 
chosen  to  have  convenient  values.  If,  say,  the  data  were 
printed  10  words  to  a  row,  10  rows  per  "page",  one  could  have 
the  instructions: 


di,  d2,  d5,  dip  d5 

d6 

d? 

dQ,  d<j,  d1Q 


*11 


erase  the  previous  1,  2,  3>  5  words. 

erase  the  current  row. 

erase  the  current  row  plus  the  row  before. 

erase  the  current  row  plus  the  2,  4 

previous  rows. 

erase  the  current  page. 


etc. 
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V.  CONCLUSIONS 

An  enumeration  of  the  possible  decision  and  informa¬ 
tion  policies  subject  to  the  restrictions  listed  in  section  II 
revealed  that  there  are  only  two  different  information  feedback 
policies  and  one  decision  feedback  policy  which  permit  fail¬ 
safe  operation.  The  decision  feedback  policy  is  the  one  de¬ 
scribed  in  a  previous  report.'1' 

The  information  feedback  system  with  a  policy  such 
that  erasure-to-confirmation  errors  are  rare  was  found  to  have 
no  advantage  over  the  decision  feedback  system,  except  possibly 
when  the  feedback  channel  is  extremely  good  and  wastage  of  feed¬ 
back  capacity  is  not  a  serious  disadvantage.  In  several  respects, 
this  system  is  almost  exactly  equivalent,  but  slightly  inferior, 
to  a  decision  feedback  system. 

The  information  feedback  system  with  a  policy  such 
that  confirmation-to-erasuTe  errors  are  rare  has  the  feature 
that  error  probability  is  a  function  of  the  number  of  information 
dibits  in  a  message  word  rather  than  the  number  of  check  digits. 
Thus,  coding  technically  is  not  required  for  reliability,  al¬ 
though  a  transformation  from  forward  received  digits  to  feed¬ 
back  transmitted  digits  is  required,  and  the  operations  involved 
in  this  operation  are  somewhat  equivalent  to  coding.  A  disad- 
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vantage  of  this  system  is  that.,  during  a  blackout,  the  receiver 
keeps  recording  erroneous  message  words.  These  are  all  erased 
eventually,  but  it  requires  that  the  receiver  (and  also  the 
transmitter)  be  able  to  retain  tentatively  a  large  number  of 
words . 

It  must  be  emphasized  that  the  above  conclusions  are 
based  on  the  assumption  of  a  strictly  binary  channel.  If,  for 
example,  the  erasure  signal  in  section  III  could  consist  of  com¬ 
plete  suppression  of  the  modulation  or  transmitted  signal,  or 
of  some  waveform  far  different  from  a  binary  sequence,  and  if 
a  transmitted  erasure  is  assumed  whenever  positive  recognition 
of  binary  digits  in  the  received  signal  is.  not  obtained,  then 
coding  might  not  be  needed  for  reliability  (except  that  a  trans¬ 
formation  from  forward  to  feedback  may  be  needed,  as  in  the  sys¬ 
tem  of  section  IV.)  The  comparison  with  decision  feedback  might 
then  be  more  favorable  for  the  information  feedback  system  of 
section  III. 

The  possibilities  of  an  extension  of  the  theory  to 
allow  non-binary  erasure  or  confirmation  signals  and  word  deci¬ 
sions  based  on  more  than  just  prior  binary  digit  decision  are 
well  worth  further  investigation. 
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APPENDIX  is  Alternate  Logic  for  the  System  Described  in 
Section  III. _ 


Instead  of  attempting  to  "erase  the  erasure",  suppose 
that  the  two  last  transmitted  messages  are  repeated  whenever  the 
sending  of  a  message  is  followed  by  the  reception  of  an  erasure 
signal  on  the  feedback  channel.  Since  it  is  not  at  all  certain 
whether  an  erasure  or  a  message  word  had  actually  been  received 
on  the  feedback  channel,  labeling  is  needed  to  permit  the  re¬ 
ceiver  to  distinguish  between  a  new  message,  a  repeat  of  the 
most  advanced  message,  and  a  repeat  of  the  second  most  advanced 
message.  This  requires  the  use  of  two  labeling  digits,  just  as 
in  the  decision  feedback  system  it  was  necessary  to  use  one 
label  digit  to  distinguish  a  new  message  from  a  repeat.  Succes¬ 
sive  message  words  are  thus  given  labels  00,  01,  10,  11,  00,  01, 
etc. 

The  transmitter  state  diagram  for  this  alternate  ap¬ 
proach  is  given  in  Figure  7.  Symbols  have  the  same  meaning  as 
in  Figure  1. 

As  a  result  of  the  transmitter  policy,  the  receiver 
initially  records  a  sequence  which  includes  the  intended  mes¬ 
sages,  some  repeated  two  or  more  times,  some  incorrect  messages 
which  need  erasing,  and  some  erasure  instructions.  To  obtain  a 
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STATE 

1 

2 

3 

4 

5 


OPERATION 

Continue  To  Next  Message 
Send  on  Erasure 

Send  Repeat  Of  Second  Most  Advanced 
Of  Prior  Transmissions 

Send  Repeat  Of  Most  Advanced 
Of  Prior  Transmissions 

Send  an  Erasure 


Fig.  7 

State  Diagram  For  The  Transmitter 
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final,  probably  error-free,  reproduction  of  the  intended  communi¬ 
cation,  the  following  two  rules  are  applied: 

a.  If  there  are  an  even  number  of  consecutive  erasures,  do 
not  erase  the  previous  message.  If  there  are  an  odd  number,  do 
erase  it. 

b.  When  label  digits  are  not  consecutive,  cross  out  after 
the  jump  as  many  as  are  needed  to  return  to  the  consecutive  order. 

An  example  of  the  application  of  these  rules  is  shown 
in  Figure  8.  In  the  figure,  decoded  messages  are  represented 
by  their  labels,  and  erasures  by  the  letter  E.  An  X  indicates 
that  a  message  is  crossed  out.  Note  that,  even  in- this  case,  an 
erasure  following  an  erasure  is  effectively  interpreted  as  an 
instruction  to  erase  the  first  erasure  instruction. 


X  X  X  X  XX 

(00  (01  fiojll  foo  I  n/oo/oo  /oo  /oi/io/io/ii/oo/  e/e/e/oo/oi/ 


ii/e  /lo/ii/e  ^/oo/oi/io/ii/oo/  01/00/  01/10/ . . . 


Figure  8 


Receiver  Erasure  Rules 
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APPENDIX  II :  Matrix  Representation  for  Information  Feedback. 

Consider  again  that  an  (n',  k)  code  is  used  in  the  for' 
ward  channel,  and  an  (n",  k")  code  in  the  feedback  channel 
(n'  +  n"  =  n,  k" f  k) .  The  feedback  sequence  can  be  determined 
entirely  from  the  forward  information  digits  by  means  of  the 
equation 


r 

=  M 

ii 

• 

f  it 

inJ 

• 

where  [MJ  is  an  n"  x  k  matrix  of  l's  and  o's,  f^  is  a  feedback 
digit ,  and  ij  is  a  forward  information  digit.  The  dimension  of 
[M]  is  k". 

Rearrangement  of  rows  and  columns  of  [ M ]  only  amounts 
to  a  renaming  of  digits.  Let  [m]  be  arranged  so  that  the  upper 
k"  x  k"  left  corner  has  an  inverse.  Let  this  corner  be  called 
M(k",  k")  ,  and  let  the  remaining  rows  in  the  first  k"  columns 
be  called  M(n"  -  k",  k")  .  Then,  fi  ...  f^n  may  be  treated  as 
information  digits  in  the  feedback  code,  and  fj;i>+^  ...  fn>i  as 


check  digits.  All  possible  combinations  of  ii  ...  ik  generate 
all  tx  • . •  fn"  sequences .  When 


i.e. ,  when  the  last  k-k"  forward  information  digits  are  zero,  it 
is  simultaneously  true  that 


Since  [M(k",  k")J  has  an  inverse. 


il 

p*  *“ 

fi 

-• 

-1 

• 

fk'^ 

=  jM(k",  k")J 

fk<r 

1*  W 

(IX-5) 


(iUO 


The  matrix  for  the  feedback  code  is  then  [M(n"-k">  k")][M(k",  k")] 
The  matrix  [m]  consists  of  the  components  as  follows! 


Given  a  choice  of  an  (n",  k")  feedback  code,  £mJ  is  determined  by 
the  following  steps! 

a.  Pick  M(k",  k")  at  random*,  subject  to  the  restriction 

that  it  have  an  inverse.  Since  the  code  fixes  [M(n"-k",  k")]  • 

-1 

fM(k",  k")]  ,  fM(n"-k",  k")J  is  then  determined. 

b.  Pick  afk-k'^x  k"  matrix  M  at  random.  This  determines 

fM(k",  k-k")]  =  fM(k",  k")]fp1]  .  (II-6) 

c.  Pick  a(n"-k")x  k"  matrix  [Ps]  at  random.  This  determines 
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[M(n"-k",  k-k")]  =  [Pe][M(k",  k-k”)]  .  (II-7) 

The  resulting  matrix  is  k"  -  dimensional,  as  desired, 
since  every  component  is  expressible  in  terns  of  M(k",  k") . 
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Belaar,  New  Jersey 
Attn:  Mr.  S.  Grossman 

Chief,  U.S.  Army  Security  Agency 
Arlington  Hall  Station 
Arlington  12,  Virginia 
Attn:  ACOFS,  G4,  TL  Section 

Caaaanding  General 

U.S.  Anny  Electronic  Proving  Ground 

Port  Huachuca,  Arizona  (AttmTechnlcal  Library,  SIOFO-W) 

U3ASBRL  (SIGRA/SLHAO,  Mr.  J.  Bartov) 

Ft.  Monnouth,  New  Jersey 

Federal  Avietion  Agency 

Bureau  of  Research  and  Development 

Washington  25,  D.C. 

Director 

National  Security  Agency 
Fort  George  G.  Meade,  Maryland 
Attn:  K  31 

Director 

Langley  Research  Center 

National  Aeronautics  and  Space  Administration 

Langley  Field,  Virginia 

HRB  Singer,  Inc. 

1517  Science  Avenue 
State  College,  Pa. 
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Autonetics 

9150  E.  Imperial  Highway 

Downey,  California 

Attn:  Technical  Library,  393-52 


Sandia  Corporation 
Sandia  Base,  P.O.  Box  58OO 
Albuquerque ,  Nex  Mexico 
Attn;  Classified  Document  Division 
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I  126  Convair,  A  Division  of  General  Dynamics  Corp. 

Fort  Worth,  Texas 

Attn:  K.  G.  Brown,  Division  Research  Librarian  83 

I  130  Parke  Mathematical  Labs,  Inc. 

Bedford  Road,  Carlisle,  Mass. 

Attn:  Dr.  Nathan  Grier  Parke,  III  84 

I  190  Motorola,  Inc. 

Phoenix  Research  Laboratory 
3102  No.  56th  Street 
Phoenix,  Arizona 

Attn:  Technical  Librarian  85 

I  194  Rand  Corporation 

1700  Main  Street 
Santa  Monica,  California 

Attn;  Dr.  A.L.  Hiebert  86 

I  228  Philco  Corporation 

Research  Division,  Plant  No.  50 
4700  Wissahickon  Avenue 
Philadelphia  44,  Pa. 

Attn:  S.  Zebrowitz  87 

I  238  General  Electric  Canpany 

Knolls  Research  Laboratory 
1  River  Road,  Schenectady,  New  York 

Attn:  Dr.  R.L.  Shuey  88 

I  266  ITT  Federal  Laboratories 

Technical  Library 
500  Washington  Avenue 

Nutley  10,  New  Jersey  89 

I  291  Radio  Corporation  of  America 

Defense  Electronic  Products 
Building  10,  Floor  7 
Camden  2,  New  Jersey 

Attn:  Mr.  Harold  J.  Schrader,  Staff  Engineer 

Organization  of  Chief  Technical  Administrator  90 

I  312  STL  Technical  Library 

Document  Acquisitions 
Space  Technology  Laboratories,  Inc. 

P.0.  Box  95001 

Los  Angeles  45,  California  91 

I  yj6  Hughes  Aircraft  Company 

Culver  City,  California 
Attn:  Dr.  S.G.  Lutz 

Communication  and  Miniaturization  Department  92 
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I  445  The  Rand  Corp. 

1700  Main  Street 
Santa  Monica,  Cal. 

Attn:  Dr.  R.E.  Kalaba  93 

I  561  Melpar,  Inc. 

11  Galen  Street 
Watertown,  Mass. 

Attn:  Librarian  94 

I  674  Stanford  Research  Institute 

Menlo  Park,  Cal. 

Attn.  W.R.  Vincent  95 

I  675  Hazeltine  Research  Corp. 

59-25  Little  Neck  Parkway 
Little  Neck  62,  New  York 

Attn:  Donald  Richmon  96 

I  784  Sylvania  Electronic  Systems 

Applied  Research  Laboratory 
100  First  Avenue 
Waltham,  Mass. 


Attn:  Seymour  Stein  97 

I  921  Litton  Systems,  Inc. 

221  Crescent  Street 
Waltham,  Mass. 

Attn:  Dr.  David  Van  Meter  98 

I  922  The  Metre  Corp. 

Middlesex  Turnpike 

Bedford,  Mass .  99 

I  957  Alton  T.  Butson 

2030  109th  St. ,  N.E. 

Bellevue,  Washington  100 

M  54  Hq.  BSD  (ESHDW,  Capt.  John  J.  Hobson) 

L.  G.  Hansccm  Field,  Bedford,  Mass.  101 

M  55  BSD  (ESRDW,  Directorate  of  Technology) 

Applied  Research  Division 
L.  G.  Hansccm  Field 

Bedford,  Moss.  102 

N  37  Office  of  Naval  Research 

Department  of  Navy 
Wash  25,  D.  C. 

Attn:  Code  427,  Electronics  Branch  103 

N  56  Chief,  Bureau  of  Aeronautics 

Department  of  the  Navy 
Wash  25,  D.  C. 

Attn:  L.A.  Aarons,  AER-EL-^3  104 
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N  57 

Chief,  Bureau  of  Ships 

Department  of  the  Navy 

Wash  25,  D.  C. 

Attn:  Mr.  D.  Head,  Code  823 

■  105 

N  59 

U.  S.  Naval  Air  Development  Center 

JohnBville,  Penn 

Attn:  Librarian 

106 

N  85 

Corananding  Officer  and  Director 

U.  S.  Navy  Electronics  Laboratory  (Library) 

San  Diego  52,  California 

107 

0  26 

Massachusetts  Institute  of  Technology 

Lincoln  Laboratory,  P.0.  Box  73 

Lexington  73,  MasB. 

Attn:  Mary  A.  Granese,  Librarian 

108 

U  37 

University  of  Michigan 

Engineering  Research  Institute 

Willow  Run  Laboratories 

Willow  Run  Airport 

Ypsilanti,  Michigan 

Attn :  Librarian 

109 

U  41 

Northeastern  University 

Electronics  Research  Lab. 

Boston,  Mass. 

Attn:  M.W.  Essigman 

110 

a  60 

New  York  University 

College  of  Engineering 

University  Heights,  New  York  53,  N.Y. 

Attn:  Mr.  Frank  J.  Bloom 

111 

U  144 

Jet  Propulsion  Laboratory 

California  Institute  of  Technology 

4800  Oak  Grove  Drive 

Pasadena  3,  California 

Attn:  Dr.  Eberhardt  Rechtin 

112 

U  157 

California  Institute  of  Technology 

Jet  Propulsion  Laboratory 

4800  Oak  Grove  Drive 

Pasadena  3,  California 

Attn:  Mr.  I.E.  Newlan,  Manager 

Technical  Reports  Section 

113 

U  286 

University  of  Michigan 

Research  Institute 

North  Campus,  Ann  Arbor,  Michigan 

Attn:  Gordon  Roberts 
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U  397 

Polytechnic  Institute  of  Brooklyn 

Microwave  Research  Institute 

55  Johnson  Street 

Brooklyn,  New  York 

Attn:  Prof.  E.J.  Smith 

115 

u  396 

Syracuse  University 

Syracuse  10,  New  York 

Attn:  Prof.  F.  Reza 

116 

U  406 

Massachusetts  Institute  of  Technology 

Department  of  Electrical  Engineering 

Cambridge,  Mass. 

Attn:  Mr.  Jack  Cowan 

117 

U  408 

Johns  Hopkins  University 

School  of  Engineering 

34th  and  Charles 

Baltimore  18,  Maryland 

Attn:  W.H.  Huggins 

118 

U  411 

Montana  State  College 

Electronics  Research  Laboratory 

Bozeman,  Montana 

Attn:  Dr.  W.  Kilmer 

119 

U395 

Advanced  Electronics  Center 
at  Cornell  University 

General  Electric  Company 

Ithaca,  New  York 

Attn:  Dr.  Robert  Turner 

120 

Hq.  AFCRL,  Office  of  Aerospace  Research  (CRRC) 

L.  G.  Hanscan  Field,  Bedford,  Mass. 

121 

Hq.  AFCRL,  Office  of  Aerospace  Research  (CRRS) 

L.G.  Hansccm  Field,  Bedford,  Mass. 

122-127 

Department  of  Defense  Agencies  and  their  prime  Contractors  may  obtain  copies  of  this  report  from 
the  Armed  Services  Technical  Information  Agency,  Arlington  Hall  Station,  Arlington  12,  Virginia. 


In  addition  to  published  papers,  the  College  of  Engineering  reports  the  results  of  its 
research  in  the  form  of  reports  to  sponsors  of  research  projects.  Technical  Reports,  and  Technical 
Notes.  The  latter  are  normally  limited  to  distribution  within  the  College.  Information  regarding 
the  availability  of  reprints  of  journal  articles  and  Technical  Reports  may  be  obtained  by  writing 
to  the  Director  of  the  Research  Division,  College  of  Engineering,  New  York  University,  New 
York,  53,  N.Y. 


The  Research  Division  of  the  College  of  Engineering  is  an  integral  part  of  the  educational 
program  of  the  College.  The  faculty  of  the  College  takes  part  in  the  work  of  the  Research  Divi¬ 
sion,  often  serving  as  co-ordinators  or  project  directors  or  as  technical  specialists  on  the  projects. 
This  research  activity  enriches  the  educational  experience  of  their  students  since  it  enables  the 
faculty  to  be  practicing  scientists  and  engineers,  in  close  touch  with  developments  and  current 
problems  in  their  field  of  specialization.  At  the  same  time,  this  arrangement  makes  available  to 
industrial  and  governmental  sponsors  the  wealth  of  experience  and  special  training  represented  by 
the  faculty  of  a  major  engineering  college.  The  staff  of  the  Division  is  drawn  from  many  areas  of 
engineering  and  research.  It  includes  men  formerly  with  the  research  divisions  of  industry,  govern¬ 
mental  and  public  agencies,  and  independent  research  organizations. 


Following  are  the  areas  represented  in  the  research  program:  Aeronautical  Engineering, 
Chemical  Engineering,  Civil  Engineering,  Electrical  Engineering,  Engineering  Mechanics,  Indus¬ 
trial  and  Management  Engineering,  Mechanical  Engineering,  Metallurgical  Engineering,  Mathe¬ 
matics,  Meteorology  and  Oceanography,  and  Physics.  In  addition,  an  interdisciplinary  research 
group  is  responsible  for  studies  which  embrace  several  disciplines.  Inquiries  regarding  specific 
areas  of  research  may  be  addressed  to  the  Director,  Research  Division  for  forwarding  to  the  appropriate 
research  group. 


